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(54) AUTOMATIC FOCUSING DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an automatic focusing 
device which can perform fast focusing operation. 
SOLUTION: An AF stop 102 has different color filters (G filter 
102a and M filter 102b) arranged at an aperture part made 
eccentric with the center of an AF lens 101 and for image 
pickup operation by AF, image data of AF areas in an image 
frame corresponding to respective pieces of luminous flux 
passing through the color filters 102a and 102b of the AF stop 
102 are obtained by colors; and a cross correlation arithmetic 
part 106 calculates the cross correlation between the image 
data by the colors and a distance and direction calculation part 
108 calculates the distance to and the direction of the focusing 
position of the AF lens 101 according to the cross correlation to L-rv^ -. J'"^ 

drive the AF lens 101 to the focusing position. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the automatic focus equipment applied 
to the image input device which used image sensors, such as a video camera and a digital 
camera, for the detail about automatic focus equipment. 

[0002] 

[Description of the Prior Art] Conventionally, various methods, such as the climbing-a- 
mountain method, a correlation method, and a cross-correlation method, are proposed by 
the focus spotting method in automatic focus equipment. Hereafter, the focus spotting 
method of these former is explained. 

[0003] As the above-mentioned climbing-a-mountain method, there are some which were 
indicated by JP,3-214868,A (automatic focus equipment) and JP,3-216078,A (automatic 
focus equipment), for example. 

[0004] The "automatic-focusing control unit" indicated by above-mentioned JP,3- 
214868,A The image sensor which changes into an electrical signal the optical 
information of the photographic subject image by which image formation is carried out to 
the image pick-up side of an image sensor through a lens, An AD translation means to 
change this changed electrical signal into a digital signal, and a memory means to store 
the above-mentioned digital signal temporarily for every frame, A coding means to detect 
the magnitude of each frequency component which performs two-dimensional orthogonal 
transformation to a frequency domain, and is contained in the above-mentioned image to 
the image formed by the above-mentioned digital signal, A focus detection means to 
detect the amplitude of the specific high frequency component in the above-mentioned 
frequency component, It has the lens driving means which adjusts the location of the 
above-mentioned lens with the control signal from this focus detection means, and the 
location of the above-mentioned lens is adjusted and it asks for a focus location so that 
the amplitude of the above-mentioned specific high frequency component may serve as 
max. 

[0005] Moreover, the "automatic focus equipment" indicated by above-mentioned JP,3- 
216078,A is equipped with the control section which generates the control signal for 
performing focus actuation based on the information on the A/D converter which changes 



the video signal supplied into a digital signal, the DC to AC converter which changes into 
a frequency component field the video signal which the above-mentioned A/D converter 
sends out, and the frequency component which the above-mentioned DC to AC converter 
sends out. 

[0006] As the above-mentioned correlation method, there are some which were indicated 
by JP,7-154668,A (automatic-focusing adjusting device), JP,7-159685,A (automatic- 
focusing adjusting device), JP,7-270674,A (picture input device with an automatic- 
focusing adjustment means), and JP,7-287162,A (focus detection equipment), for 
example. 

[0007] The "automatic- focusing adjusting device" indicated by above-mentioned JP,7- 
154668, A It is what drives the focus means of two methods and focuses photography 
optical system based on the information from an optoelectric transducer that image 
formation of the photographic subject image is carried out through photography optical 
system. The focus means of the 1st method It carries out to migration of an image pick- 
up lens serially with focal evaluation of a photographic subject image, and the place used 
as the maximum of an evaluation value is made into a focusing point. The focus means of 
the 2nd method By the method which the diaphragm which has two openings is located 
in photography optical system, and divides one photographic subject image into two 
optical paths, is made to carry out image formation to an optoelectric transducer, and 
judges a focus and un-focusing by the difference in an image formation location It 
focuses with the focus means of the autocorrelation method which is the 2nd method 
first, and then focuses with the focus means of the mountain-climbing method which is 
the 1st method. 

[0008] Moreover, the "automatic- focusing adjusting device" indicated by above- 
mentioned JP,7-159685,A The 1st focus means which focuses a photographic subject 
from the information on two or more photographic subject images which carry out image 
formation through a different optical path. In the equipment which has the 2nd focus 
means which focuses a photographic subject from the information on one photographic 
subject image which carries out image formation, uses each focus means in the lst-2nd 
sequence, and performs focus actuation The property of the filter for a signal extract 
suitable for a setup of a ranging frame and each photography scene where the far and near 
contention used for the focus actuation which the 1st focus means depends does not take 
place is determined. 

[0009] Moreover, "the picture input device with an automatic-focusing adjustment 
means" indicated by above-mentioned JP,7-270674,A An image formation means to 
carry out image formation of the photographic subject image to a photographic subject 
image detection means to detect a photographic subject image, A light exposure 
adjustment means to have the converging section material which adjusts the quantity of 
light of the flux of light which passes an image formation means, and the shutter member 
which adjusts the exposure time. In case it has a focal judging means which is different 
based on the signal from a photographic subject image detection means, respectively and 
focus control of an image formation means is performed using the signal from two or 



more focal judging means, a light exposure adjustment means adjusts an exposure 
condition according to the class of judgment means, and the brightness of a photographic 
subject image. 

[0010] Moreover, the "focus detection equipment" indicated by above-mentioned JP,7- 
287 162, A The diaphragm which has two or more openings divides the pupil of a 
photography system into two or more fields. Two or more image information based on 
the flux of light which passed through two or more divided this fields is formed on a 
color image pick-up means side. When the focus condition of this photography system is 
detected in two or more focus locations using the picture signal fi-om this color image 
pick-up means, the focus detection method selection means after detecting these two or 
more focus locations - this ~ or [ focusing using other 2nd different focus means from 
the 1st focus means ] ~ or ~ this ~ it chooses whether the 1st focus means performs 
focus actuation, and the focus condition of this photography system is detected. 

[001 1] As a describing [ above ] cross-correlation method, there are some which were 
indicated by JP,5-103251,A (automatic focus equipment) and JP,6-250077,A (automatic 
focus equipment using a single lens), for example. 

[0012] The "automatic focus equipment" indicated by above-mentioned JP,5-103251,A It 
has the light sensing portion which carries out image formation of the image of the body 
for a focus, and the lens prepared between this light sensing portion and the body for a 
focus. Establish a quantity of light adjustment means to change the amount of incident 
light to some light sensing portions of the light from the body for a focus, and the 
modification location of the amount of incident light to said light sensing portion by this 
quantity of light adjustment means is set in the field of a lens with a change means. It 
changes to at least 2 locations, correlation of the video signal from the li^t sensing 
portion in these at least 2 locations is searched for in correlator, the direction and 
discrepancy of a focal gap are judged with a judgment means, and the distance of a lens 
and a light sensing portion is controlled based on the decision output of this judgment 
means. 

[0013] Moreover, "the automatic focus equipment using a single lens" indicated by 
above-mentioned JP,6-250077,A The optical system of automatic focus equipment is 
constituted from a single lens and a mask arranged before this lens or to the backside. 
The mask which it converged with the lens separates, a CCD sensor is irradiated, and 
laser light is made to focus automatically to a workpiece by moving an objective lens, 
taking correlation between two output signals outputted from a CCD sensor. 

[0014] 

[Problem(s) to be Solved by the Invention] However, although AF evaluation value in the 
incorporation location of an image is acquired by the focus method by the above- 
mentioned climbing-a-moxmtain method, it is difficult to detect in which a focusing point 
shall exist between the front of this auto- focus lens location, or back. For this reason, 
since AF evaluation value of the whole region of a lens successive range is needed in 
order to avoid the maximum point and to detect a focus location, the actuation which the 



count of photography for this whole region is needed, and is returned to a focusing point 
location is added, and there is a problem of taking time amoimt before obtaining an exact 
focal location. 

[0015] Moreover, by the focus method by the above-mentioned correlation method, 
although picturized on one frame about the two or more different flux of lights, while this 
can acquire AF information from the incorporation image for one frame, although it is 
correlation by the same data therefore, it results in showing very high peak value in the 
home position (focusing point) of an auto correlation coefficient. For this reason, there is 
a problem that it cannot but depend on other methods near the focusing point. 

[0016] Moreover, by the focus method by the describing [ above ] cross-correlation 
method, although each is picturized on another frame about the two or more different flux 
of lights, while this needs to prepare two or more frames, it does not produce very high 
peak value in a home position like a correlation method. AF information can be acquired 
without being buried in this peak value from this from [ near the focusing point ] to a 
distant place. However, the computational complexity of the cross-correlation operation 
about the whole frame has crossed the practical range, and there is a problem at the point 
which requires time amount. 

[0017] This invention is made in view of the above, and aims at offering the automatic 
focus equipment in which high-speed focus actuation is possible. 

[0018] 

[Means for Solving the Problem] In order to solve the above-mentioned technical 
problem, the automatic focus equipment conceming claim 1 The auto-focus lens for 
doubling the focus of the photographic subject for a focus, and a color image pick-up 
means to change into an electrical signal the photographic subject image of the 
photographic subject for [ by which image formation is carried out ] a focus, and to 
output as image data, Opening in a mutually different eccentric location to the core of an 
auto-focus lens, respectively ******^ it has AF diaphragm which restricts the flux of 
light from the photographic subject for [ said ] a focus with which a color filter which is 
different in each opening concerned has been arranged, respectively. A part of image 
frame picturized by said color image pick-up means is set up as AF area. In the image 
pick-up for AF The image data of AF area in each image frame according to each flux of 
Ught which passes each color filter of said AF diaphragm is acquired, respectively. The 
cross-correlation between the image data of said AF area is computed, the distance and 
the direction of [ to the focus location of said auto-focus lens ] are computed based on the 
cross-correlation concemed, and the auto-focus lens concerned is driven in a focus 
location. 

[0019] Moreover, in the automatic focus equipment which the automatic focus equipment 
conceming claim 2 requires for claim 1, one side of said different color filter consists of a 
primary color filter, and another side consists of a complementary filter. 

[0020] Moreover, in the automatic focus equipment which the automatic focus equipment 



concerning claim 3 requires for claim 2, said primary color filter consists of a G filter, 
and said complementary filter consists of an M filter. 

[0021] Moreover, an auto-focus lens for the automatic focus equipment conceming claim 
4 to double the focus of the photographic subject for a focus, A color image pick-up 
means to change into an electrical signal the photographic subject image of the 
photographic subject for [ by which image formation is carried out ] a focus, and to 
output as image data. Opening in a mutually different eccentric location to the core of an 
auto-focus lens, respectively it has AF diaphragm which restricts the flux of 

light from the photographic subject for [ said ] a focus with which a color filter which is 
different in each opening concerned has been arranged, respectively. A part of image 
frame picturized by said color image pick-up means is set up as AF area. In the image 
pick-up for AF The image data of AF area in each image frame according to each flux of 
light which passes each color filter of said AF diaphragm is acquired, respectively. The 
cross-correlation between the image data concemed is computed, and based on the cross- 
correlation concerned, the focus location of the outline of the auto-focus lens concerned 
is computed by computing the distance and the direction of [ to the focus location of said 
auto-focus lens ]. Further near the focus location of said outline A final focus location is 
judged based on the high frequency component of the image data of AF area picturized 
and obtained. 

[0022] 

[Embodiment of the Invention] The gestalt of the suitable operation which applied the 
automatic focus equipment applied to this invention with reference to an accompanying 
drawing below to the digital camera is explained to a detail. 

[0023] (Gestalt 1 of operation) Drawing 1 shows the block diagram of AF processor of 
the digital camera conceming the gestalt 1 of operation. In this drawing, 101 is for the 
auto-focus lens arranged on an optical axis being shown, and carrying out image 
formation of the photographic subject image of the photographic subject for a focus on 
the primary color system image sensors 103. 102 is for restricting the flux of light 
(quantity of light) which shows AF diaphragm, is arranged at the backside [ an auto-focus 
lens 101 ], and passes an auto-focus lens 101. The AF diaphragm 102 in the gestalt of this 
operation prepares two openings in a different eccentric location to the core of an auto- 
focus lens 101, and is arranging G filter 102a and M filter 102b in each opening, 
respectively (refer to drawing 3 ). 103 shows the primary color system image sensors 
which consist of a color CCD which changes into an electrical signal the photographic 
subject image by which image formation was carried out, and is outputted as image data 
of R, G, and B. The random access of a pixel of these primary color system image 
sensors 103 has become possible, and the image data of the area of the arbitration in an 
image frame can transmit them. These auto-focus lenses 101, the AF diaphragm 102, and 
the primary color system image sensors 103 constitute the optical system for an image 
pick-up. 

[0024] 112 shows the mixed mode operation section which carries out mixed mode 
operation of the image data (R data) of AF area in the frame R outputted from the 



primary color system image sensors 103, and the image data (B data) of AF area in the 
frame B outputted from the primary color system image sensors 103, and outputs the 
image data of M color (complementary color) in the image pick-up for AF. 104 is 
outputted from the primary color system image sensors 103 in the image pick-up for AF. 
The image memory (for AF area of G filter) which stores the image data of G of AF area 
in the image frame (frame G) according to the flux of light which passes G filter 102a of 
the AF diaphragm 102 is shown. 105 shows the image memory (for AF area of M filter) 
which stores the image data (M data) of AF area outputted from the mixed mode 
operation section 1 12. 106 shows the cross-correlation operation part for [ which was 
stored in image memories 104 and 105 ] asking for the correlation coefficient between 
the image data of AF area, respectively. The two-dimensional FFT section 200 for this 
cross-correlation operation part 106 to carry out the two-dimensional FFT operation of 
the 1st image data stored in the image memory 104, The two-dimensional FFT section 
201 for carrying out the two-dimensional FFT operation of the 2nd image data stored in 
the image memory 105, It consists of the complex multiplication section 202 which 
carries out complex multiplication of 2 sets of image data by which two-dimensional FFT 
was carried out, respectively in the two-dimensional FFT section 200 and the two- 
dimensional FFT section 201, and a two-dimensional IFFT section 203 which carries out 
two-dimensional IFFT of the result by which complex multiplication was carried out in 
the complex multiplication section 202. 

[0025] 107 shows the cross-correlation coefficient memory which stores the correlation 
coefficient calculated by the cross-correlation operation part 106. 108 shows the range 
direction calculation section 108 which computes the distance and the direction of [ to the 
focus location of an auto-focus lens 101 ] based on the correlation coefficient calculated 
with the cross-correlation computing element 106. 

[0026] 109 shows the auto-focus lens drive for moving an auto-focus lens 101 on an 
optical axis, and performing focus control based on the result of an operation of the cross- 
correlation operation part 106. 110 shows the diaphragm change device which controls 
actuation of the AF diaphragm 102 while performing the change of the AF diaphragm 
102 in AF actuation and photography actuation of operation. Ill shows the image 
memory for frames by which the image data for one picturized frame is stored for every 
color in the usual photography. 

[0027] Drawing 2 shows the image frame and its AF area of the primary color system 
image sensors 103. The primary color system image sensors 103 are arranged band-like 
in the sensor of R, G, and B, or alternately. In this drawing, the frame of the image data 
according the frame of the image data according the frame of the image data based on R 
sensor to Frame R and G sensor to Frame G and B sensor is used as Frame B, and AF 
area (focal location) is set up in Frame R, Frame G, and Frame B. This AF area is good as 
for it being good also as a configuration which can be set as arbitration in the case of 
photography, and setting it as it beforehand by the photography person. 

[0028] Drawing 3 is an explanatory view for explaining incorporation of the flux of light 
by the above-mentioned AF diaphragm 102, and shows typically the AF diaphragm 102, 



the primary color system image sensors 103, image memories 104 and 105, and the 
mixed mode operation section 1 12. As shown in this drawing, 2 sets of openings are 
prepared in the eccentric location where the AF diaphragms 102 differ to the core (optical 
axis) of an auto-focus lens 101, and G filter 102a and M filter 102b are arranged by each 
opening. From G filter 102a, the flux of Ught (flux of light G) of G component passes, 
firom M filter 102b, the flux of light (flux of Ught M) of M component passes, and image 
formation is carried out on the primary color system image sensors 103. 

[0029] G sensor outputs the image data (G component) of AF area in the fi-ame G of the 
flux of light G which received light to an image memory (for AF area of G fiUer) 104. R 
sensor outputs the image data (R component) of AF area in the frame R of the flux of 
light M which received light to the mixed mode operation section 112, and B sensor 
outputs the image data (B component) of AF area in the fi-ame B of the flux of light M 
which received light to the mixed mode operation section 112. The mixed mode 
operation section 112 carries out mixed mode operation of the image data of R 
component and the image data of B component to input, and outputs the image data of M 
component to an image memory (for AF area of M filter) 105. 

[0030] Below, the principle of AF actuation of the above-mentioned digital camera is 
explained with reference to drawing 4 . Drawing 4 is an explanatory view explaining the 
principle of AF of the above-mentioned digital camera, and shows typically an auto-focus 
lens 101, the AF diaphragm 102, and the primary color system image sensors 103. In this 
drawing, (a) shows the passage condition of the flux of light 1 (flux of light G) passed 
fi-om G fiher 1 02a of the AF diaphragm 102, and (b) shows the passage condition of the 
flux of Ught 2 (flux of Ught M) passed from M filter 102b of the AF diaphragm 102. 

[0031] First, in the image pick-up for AF, as shown in this drawing (a) and (b), the flux 
of Ught 1 (flux of light G) and the flux of Ught 2 (flux of Ught M) pass to coincidence, 
respectively from G fiher 102a of the AF diaphragm 102, and M filter 102b, image 
formation of the flux of Ught 1 (flux of light G) and the flux of Ught 2 (flux of U^t M) is 
carried out on the primary color system image sensors 103, and they are incorporated by 
the primary color system image sensors 103, In primary color system image sensors, G 
sensor outputs the image data (G component) of AF area in the frame G of the flux of 
light G which received light to an image memory (AF area for filter G) 104. R sensor 
transmits the image data (R component) of AF area in the frame R of the flux of light M 
which received light to the mixed mode operation section 112, and B sensor transmits the 
image data (B component) of AF area in the frame B of the flux of light M which 
received light to the mixed mode operation section 112. The mixed mode operation 
section 112 carries out mixed mode operation of the image data of R component and the 
image data of B component to input, and transmits the image data of M component to an 
image memory (AF area for filter M) 105. That is, 2 sets of image data, picking 
******** and AF area, is separately outputted for each flux of light by one photography. 

[0032] Then, it detects how many these two image data have shifted in which direction 
from the direction and distance from a home position to the peak point (sunspot) of a 



correlation value by asking for a mutual cross correlation function from 2 sets of these 
image data. 

[0033] Drawing 5 is drawing showing an example of the relation of the cross correlation 
function of the image data of AF area of G filter (flux of light G), and the image data of 
AF area of M filter (flux of light M). In this drawing, (a) shows the case of a front focus, 
(b) shows the case where it is focusing and (c) shows the case of rear focusing. It asks for 
a cross correlation function (33) from 2 sets of these image data (31 32), and detects how 
many these two image data have shifted in which direction from the direction and 
distance from a home position to the peak point (sunspot) of a correlation value. Based on 
this detection result, the distance and the direction of [ to the focus location of an auto- 
focus lens 101 ] are computed. In addition, when it is shown that it is in a location distant 
from a focus location and there is no gap so that extent of gap is large, it is shown that it 
is a focus location. 

[0034] Below, the outline of whole actuation of the above-mentioned digital camera is 
explained with reference to drawing 1 . First, if the shutter carbon button which is not 
illustrated will be in the condition of half-push by actuation of an operator, the optical 
system for an image pick-up of a digital camera will operate as an AF sensor. First, in the 
image pick-up for AF, the flux of light 1 (flux of light G) and the flux of light 2 (flux of 
Ught M) pass to coincidence, respectively from G filter 102a of the AF diaphragm 102, 
and M filter 102b, image formation of the flux of light 1 (flux of light G) and the flux of 
Ught 2 (flux of light M) is carried out on the primary color system image sensors 103, and 
they are incorporated by the primary color system image sensors 103. In the primary 
color system image sensors 103, G sensor outputs the image data (G component) of AF 
area in the frame G of the flux of light G which received Ught to an image memory (AF 
area for filter G) 104. R sensor transmits the image data (R component) of AF area in the 
frame R of the flux of light M which received light to the mixed mode operation section 
112, and B sensor transmits the image data (B component) of AF area in the frame B of 
the flux of light M which received light to the mixed mode operation section 112. The 
mixed mode operation section 112 carries out mixed mode operation of the image data of 
R component and the image data of B component to input, and transmits the image data 
of M component to an image memory (AF area for fflter M) 105. The flux of light which 
is different by one image pick-up will be incorporated. 

[0035] Next, in the cross-correlation operation part 106, the operation of the cross 
correlation function of 2 sets of image data (image data of AF area of G filter and M 
filter) stored in image memories 104 and 105 is performed. In calculating 2 sets of these 
image data directly in a space field, such a huge sum-of-products operation is needed, and 
the operation time serves as size that AF area becomes large. When the image data of G 
filter 102a of AF area and M filter 102b is respectively set to f (u, v) and g (u, v) and a 
cross correlation function is set to h (u, v), h (u, v) is expressed like a bottom type (1) in a 
cross correlation function. 



[0036] 

h(u,v)=f(u,v) *g(u,v)...(l) 



However, * shows the notation of a correlation operation. 

[0037] With the gestalt of this operation, the operand is sharply reduced by transposing a 
space field to the multiplication in a frequency domain. 

[0038] In the two-dimensional FFT sections 200 and 201, the two-dimensional Fourier 
transform is performed, respectively about the image data f (u, v) and g (u, v) of G filter 
102a of AF area stored in image memories 104 and 105, respectively, and M filter 102b, 
and, specifically, it changes into the data F (U, V) and G (U, V) of a fi-equency domain. 

[0039] Continuing, the complex muhiplication section 202 performs complex 
multiplication as shown in a bottom type (2) to the data F (U, V) and G (U, V) of a 
fi-equency domain, and computes the cross correlation function H of a fi*equency domain 
(U,V). 

[0040] 

H(U, V) =F(U, V) xG(U, V) * ... (2) 

However, G(U, V) * It is the complex conjugate of G (U, V). 

[0041] And the two-dimensional IFFT section 203 computes a cross correlation function 
h (u, v) by carrying out two-dimensional inverse Fourier transform of the cross 
correlation function H of a fi-equency domain (U, V). This becomes computable [ a cross 
correlation function h (u, v) ] in the small amount of operations. This cross correlation 
function h (u, v) is stored in the cross-correlation coefficient memory 107. 

[0042] The range direction calculation section 108 computes the distance and the 
direction of [ fi'om the distance or the direction of the point and zero (focusing point) 
used as the peak of the cross correlation function h (u, v) stored in the cross-correlation 
coefficient memory 107 to (refer to drawinR 5 ), and the current position and the focus 
location of an auto-focus lens 101 ]. AF optical-system drive circuit 109 moves a focus 
location for an auto-focus lens 101 based on the distance and the direction of [ to the 
focus location of an auto-focus lens 101 ] which were computed in the range direction 
calculation section 108. AF actuation is ended in the above actuation. In addition, in 
order to raise the precision of a focus, after making it once move to a focus location, you 
may decide to carry out by repeating the above-mentioned AF actuation, and to raise the 
precision of a focus more. 

[0043] After AF actuation is completed, according to the diaphragm change device 110, 
the AF diaphragm 102 is removed fi-om the optical system for an image pick-up, and 
preparations of this photography of a photographic subject are made. And after migration 
of an auto-focus lens 101 is completed, it will be in the condition of all push waiting of a 
shutter carbon button. 

[0044] Then, if all push [ a shutter carbon button ], it will be interlocked with, a fixed 
time amount shutter will open, and the photographic subject image fi"om a photographic 
subject will be received with the primary color system image sensors 103. And photo 
electric conversion of the photographic subject image is carried out with the primary 
color system image sensors 103, and as image data, it is transmitted to the image memory 
1 1 1 for fi-ames for every color, and is once stored. And after transmitting the image data 



stored in the image memory 1 1 1 for frames to the image-processing system of the latter 
part which is not illustrated and passing through image processings, such as a white 
balance, preservation or a monitor display is carried out. 

[0045] As explained above, with the gestalt 1 of this operation the AF diaphragm 102 A 
color filter (G fiUer 102a, M filter 102b) which is different in opening allotted to a 
different eccentric location to the core of an auto-focus lens 101 is arranged, respectively. 
In the image pick-up for AF The image data of AF area in the image frame according to 
each flux of light which passes each color filters 102a and 102b of the AF diaphragm 102 
is acquired according to a color. The cross-correlation operation part 106 The cross 
correlation function between the image data according to the color concerned is 
computed. The range direction calculation section 108 Since the distance and the 
direction of [ to the focus location of an auto-focus lens 101 ] are computed and the auto- 
focus lens 101 concemed is driven in a focus location based on the cross correlation 
function concemed, by one photography for AF, the distance and the direction of [ to a 
focus location ] can be acquired, and high-speed focus actuation is attained. That is, the 
two different flux of lights are distributed to another frame, respectively, the image data 
of AF area of each frame is acquired, respectively, and it asks for a correlation coefficient 
about 2 sets of these image data, and it becomes possible to make it focus quickly to the 
image area (AF area) which wants to focus, without requiring a ranging detector (AF 
sensor module), since it is the configuration which computes the distance and the 
direction of [ to the focus location of an auto-focus lens 101 ] based on the cross 
correlation function concemed. 

[0046] Moreover, since the primary color filter and the complementary filter are used, 
when primary color system image sensors are used as a color filter with the gestalt 1 of 
this operation, the flux of light which passed the primary color filter is sensed by the 
sensor of a certain Isshiki, can sense the flux of light which passed the complementary 
filter by the sensor of other two colors, and becomes easy [ separating and incorporating 
the two flux of lights ]. 

[0047] Moreover, since the primary color filter was used as G filter and the 
complementary filter was used as M filter with the gestalt 1 of this operation, when 
primary color system image sensors are used, the flux of light which passed G filter can 
be sensed by G color sensor, the flux of light which passed M filter can be sensed by R 
color and B color sensor, and it becomes easy to separate and incorporate the two flux of 
lights. 

[0048] (Gestalt 2 of operation) Drawing 6 shows the block diagram of AF processor of 
the digital camera concerning the gestalt 2 of operation. The configuration with which AF 
processor of the digital camera of the gestalt 2 of operation shown in drawing 6 differs 
from the gestalt 1 of operation is a point equipped with the RF detecting element 113 
which detects the high frequency component of the data F (U, V) and G (U, V) of the 
frequency domain of the image data by which the two-dimensional Fourier transform was 
carried out in the two-dimensional FFT sections 200 and 201, since other configurations 



are the same as the configuration of drawing 1 , the part of an equivalent configuration 
attaches the same sign as drawing 1 , and explanation of this part is omitted. 

[0049] In the digital camera of the gestalt 2 of operation, AF actuation of the gestalt 1 of 
operation, i.e., the cross correlation function of the image data of AF area according to 
the flux of light G and the image data of AF area according to the flux of light M, is 
computed, the focus location of an outline is computed by computing the distance and the 
direction of [ to the focus location of an auto-focus lens 101 ] based on the cross 
correlation function concerned, further, it is near the focus location and a final focus 
location is determined by the climbing-a-mountain method. The point that the high 
frequency component of the image data of AF area serves as a peak is computed by the 
high frequency detecting element 113, and, specifically, the range direction calculation 
section 108 judges the point that the high frequency component of the image data of AF 
area serves as a peak to be a focus location. And AF optical-system drive circuit 109 
moves an auto-focus lens 101 to the focus location computed in the range direction 
calculation section 108. 

[0050] As explained above, with the gestalt 2 of this operation the AF diaphragm 102 A 
color fiher (G filter 102a, M filter 102b) which is different in opening allotted to a 
different eccentric location to the core of an auto-focus lens 101 is arranged, respectively. 
In the image pick-up for AF The image data of AF area in the image frame according to 
each flux of light which passes each color filters 102a and 102b of the AF diaphragm 102 
is acquired according to a color. The cross-correlation operation part 106 The cross 
correlation function between the image data according to the color concemed is 
computed. The range direction calculation section 108 Based on the cross correlation 
function concemed, the distance and the direction of [ to the focus location of an auto- 
focus lens 101 ] are computed, and it asks for the focus location of an outline. Near the 
focus location of an outline further the RF detecting element 113 Based on the high 
frequency component of the image data of AF area picturized and obtained since a final 
focus location is judged, it becomes there is no focus mistake (when converging on the 
maximum point which is one of the faults of the climbing-a-mountain method), and 
possible to focus to high degree of accuracy more. Moreover, the filter circuit for high 
frequency component detection which can ask for a frequency component in the two- 
dimensional FFT section used in case a cross correlation function is computed, and is 
usually needed by the climbing-a-mountain method becomes xmnecessary. 

[0051] In addition, this invention is not limited to the above-mentioned gestalt of 
operation, and can be suitably changed in the range which does not change the summary 
of invention. 

[0052] Moreover, the automatic focus equipment of this invention is widely applicable to 
the image input device which used image sensors, such as a video camera and a digital 
camera. 

[0053] 

[Effect of the Invention] As explained above, according to the automatic focus equipment 



concerning claim 1, opening in a mutually different eccentric location to the core of an 
auto-focus lens, respectively AF diaphragm which restricts the flux of light from 

the photographic subject for [ said ] a focus with which a color filter which is different in 
each opening concemed has been arranged, respectively is established. A part of image 
frame picturized is set up as AF area. In the image pick-up for AF The image data of AF 
area in each image frame according to each flux of light which passes each color fiher of 
AF diaphragm is acquired, respectively. Since the cross-correlation between the image 
data of AF area is computed, the distance and the direction of [ to the focus location of an 
auto-focus lens ] are computed based on the cross-correlation concemed and the auto- 
focus lens concerned is driven in a focus location By one photography for AF, the 
distance and the direction of [ to a focus location ] can be acquired, and high-speed focus 
actuation is attained. 

[0054] Moreover, since [ according to the automatic focus equipment concerning claim 2 
/ another side ] one side of a different color filter was used as the primary color filter in 
automatic focus equipment according to claim 1 and it consists of a complementary filter 
When primary color system image sensors are used, the flux of light which passed the 
primary color filter is sensed by the sensor of a certain Isshiki, can sense the flux of light 
which passed the complementary filter by the sensor of other two colors, and becomes 
easy [ separating and incorporating the two flux of lights ]. 

[0055] Moreover, since according to the automatic focus equipment concerning claim 3 
the primary color filter was used as G filter and the complementary filter was used as M 
filter in automatic focus equipment according to claim 2 When primary color system 
image sensors are used, the flux of light which passed G filter can be sensed by G color 
sensor, the flux of light which passed M filter can be sensed by R color and B color 
sensor, and it becomes easy to separate and incorporate the two flux of lights. 

[0056] According to the automatic focus equipment concerning claim 4, opening in a 
mutually different eccentric location to the core of an auto-focus lens, respectively 
Moreover, AF diaphragm which restricts the flux of light from the photographic 

subject for [ said ] a focus with which a color filter which is different in each opening 
concemed has been arranged, respectively is established. A part of image frame 
picturized is set up as AF area. In the image pick-up for AF The image data of AF area in 
each image frame according to each flux of light which passes each color filter of AF 
diaphragm is acquired, respectively. The cross-correlation between the image data of AF 
area is computed, based on the cross-correlation concerned, the distance and the direction 
of [ to the focus location of an auto-focus lens ] are computed, and the focus location of 
the outline of the auto-focus lens concemed is determined. Further near the focus location 
of an outline Based on the high frequency component of the image data of AF area 
picturized and obtained since a final focus location is judged, a high speed and highly 
precise focus actuation are attained. 
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y^?--J±. ^3feLfv:3iS^M(?)7U— AB|*lc7)AFxUr 
<0l8iT-^ (B)S:>i-) Srii-^jiiLgpi 1 2{:ii£j|lt 
h . ii-&?mgi5 1 1 2 {4. A^J-ri. RJ«ii-c0B«T-^ 50 
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8 

-^^W^^^^i (^-f^l^rJ'MfflAFX'jT) 10 5{C 

ac:*it. AFxUT02ffioBfilT-^'**ai:>j§ii 
a, 

[0 03 2] Cicof*, ;<;02ffl«0B«x-:J'*><;>SV^i0 

mjmm.^^^hzhi.zi.'o . mMim-towm 
miSiT-i'i}^t'cowii}icr,ufi]izxux\.^ii}^mtii-r 

[0 03 3] 05{4, G7><;1^^' (it^G) (OAFX'J 
T^0BfilT-^'i:M7^;^:^' (3K^M) OAFx>jr<^ 

^. |n|Ht;:t3V^-C, ( a) (4, mb-yco^^Sr^L. 
( b ) M^%\^x\.^h^^^^\.. ( c ) {imeycoJ* 

■^Sr^-r. .I<?)2ffltfOB«T-:5' (31, 32) 

(33) -km. w^'SLm^hmm^^- 

-is^i)it'(7)mmt'(7)ijHzxux\i^i>i}^mtiiti>> z 
(ommmzm-:ft , a f u i o i coirMimtx' 

^mmpi^m^^QMizh^^bk^^L. x\^m\^m 
'^mmx'hizbk^Lx^'^h. 

[0034] ort. IMiTi^i^JV:^^ ^O^ftslftf^O 

mw&mimmLxmmt^, t-r. mm<^miz 

J:^-C. m^L^^^^i^^-yi^t^^yiJ^^mKomtiz^j: 
hb. 'fi^^)Vi]Ay<r)mm^^mikF-^y^~b 

10 2<7)G7^;l'^'l 02a, M7 -f ^P^- 1 0 2 b*»;i> 

-eix-fti3Kmi , m.2 (mM) mmz 
jiiSL. m.1 {m.G) . 3^2 imM) 
-(^-i^-ty^-io 3±i,zi^m^ti. m^^-^j(-=j 

-by-t-l 0 3t;iOffi03a=^ixl.. JSfe^-^;<-i^-b 
y-t-1 0 3tibH>T{4. G-\zy^-ii. ^%Lti^ 

G<:07^-AG|*IC0AFxUr<?5BMx-^ (G{£^)-) 
$:Bffip<^'J (7'f;t^:?GfflAFX>Jr) 1 04{cai^J 
•ri.. R-by-9--{i. S3ttJt3t^M<7)7k-AR|*lc7) 
AFXi;roB«T-:J' (R^^) S-S^«»S51 1 2 
{zMML. ttz. B-by9--{4. S3tt;t3fe^Mc07^ 
-ABF«3<7)AFxijT<7)B^r-^ (Bfig^) Srfi-^Ji 
grSBl 1 2CC3M-r^. ii^«i[g|51 1 2{i, A:»]-tS 

R^^a-i^Bmr-^ i: Bj«^(7)BmT-^ b t:m^m% 

M^^(;7)BfilT-:5'S-Bm;><^:U (7 >f /l^rJ'MfflA 
FX 'J T ) 10 5 [zumtt , -iaioa«-CM^rofc3t 

mm'Oih.t.tih^ib^ztxh. 

[ 0 0 3 5 ] ort, fflSISMjUiEgf 1 0 6 -CJi, B« 
^*U104. 1 0 5(:tSiW§n:'i2ffl(55B«T-:5' 
(G7 -f;P:5'iJj;t/M7 ;l^^'OAFx'jr<0Ht6T- 

x-^S:SfSffl^-CEitm^-tSJi^tc(4, AFXUT 



(6) 



AFXUT<^G7^;1^5'1 0 2a, M7-fyl^ !>. 
^-1 02b£7)BfllT-^'S:#>!?f (u. v) . g (u, [0036] 

v) tL. nmmm^h (u, v) ti-?>t. ffls* 

h (u, v) =f (u, v) ★g (u, v) • • • (1 ) 
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1 0 



[ 0 0 3 8 ] MfifcWWi, 2iJ:7cFFTgP2 0 0. 2 0 10 

1 X'it. am^^ y 1 0 4 , 105 iz^ti^-timi^ti 

f^AFX!JrcOG7'f;P:5'l 02a. My^jVi'l 02 
b<OB®T-:J'f (u, v).g(u,v) fcOV^t:^^ 

H (U, V) =F (U, V) XG (U, V) 
fztll. G (U, V) • {i. G (U. V) oa^^at' 
$>!.. 

[0041] ^IX. 2<J:7ClFFTai2 0 3{i. 

mmmmmmma ( u , v ) s: 2 d:7iy-v x.m 
mix. mmmh (u. v) ^©ajfs, -iti 
(cio, ^-^v^««-cffli:ffi^<^sth (u, v) 20 

ai^^sTjgt^:!., i^OffiSfflW^h (u. v) (i, ffl 
SfflM^Sc^t 'J 1 0 7{Ct&tt§ii|., 
[0042] SElt^rifilSttJSP 1 0 8{i, fflSfflM^^^ 
^ y 1 0 7 t<Stt§tt^v:ffl5fflMfSS[h ( u , v ) 

5#Bg) . AFVyX10 1c7)]S4{iSi:-^^fi[ai;-C' 
cOlEiit:^|6l&a[ffi-r'&. AF3|£¥^|gi&|gg|10 9 

Ji. ggf8ttr[6is:ajl5i 0 8-cStilStx^AF^yXi 0 
liO^m{iS*t'<Og0ii::^rf6it«-:f§, AFVyXl 

0 1 i:'kMmmt:m^-^h, liitrnf^x-AFmrni 30 

[0043] AFttf^*<*5T-ri. fc . mmmm 1 1 
ofcj: 0, AFgjo 1 0 2immm^m-(^ii-t^ 

1 0 1 <^^mimj-ti> t. i^^-v^^^^ ycr>:^W 
[0044] Zcom. i^-c-y^^t'i^yij^MPL^iXl 

t . ^inzm ix-^m^i^^ -y ^ii^m% . w?-wt- 40 
^mMi^mw^^^ ^-'j^y^- 1 0 3X'^%-f 

\t%^m^ilXm^T—? tLX . 

fflBH^^ u 1 1 w^z^^ixx-mm^ixi,. -et 

X. 7^-Affl®®^^>J 1 lUzim^ixfcm^r- 

myr^L^j:\^m.(mmm^^zm.m^ix. ^j^^^f 
[0045] ^xmmLfzi. 0 *iist^ojgs 1 X' 

AFjsgiJ 1 0 2{i:. AFU-yXl 0 l<?D4''i:>t^*U*50 



8^^2»:7E7-';xSa^Srfi=V\ ia«^l^c7)r-^^F 

(u, V) . G (u. V) {zmth. 

[0039] O^V>T . MmmU20 2{i. ^fe^ffl 
Wif-^F (U, V) , G (U. V) {znLX. TsC 

( 2 ) tsti a ^rsssir^ v\ wimmimm. 
^mmM (u, V) ^icffl^i,. 

[0040] 

• ■ (2) 

^ (G7-f;^^'l 02a. M7.f/P^'l 02b) Sr^>? 
lEBL. AF cr)fzt>(r>mmi'\t. AF^'3 10 2<O#fe 
7^ /L-^- 102a. 102b $:ffl3a-ri.#3\i«tiE tfz 
Art(7)A F X U TiOBfilT-:? Srfe5"JKIX# 

ffi5isMsi»a5i 0 6{±. ^m^mm-m 
mm)mm.^zm-:i^. afi^vxi 0 lo-^a* 

^T'«osgSit:Sri6]^»:fct5LT. aSAFi^yxi 0 1 
^fiStlMfrr^ Zbt Ltz<nx\ A F <r>fzih(r> l HI 

<nm>x. -^eat ^£7)801 1 ^risj^fti, ^ t *^'T' 
tOAFx»;7<7)B«f-^'Sr*'<?Kf#t. z<n2Wm 

%rf-^\.z-^\^xmm.-km>. mms.mm.\iz 

m^%AFvyX\ 0 \<n^m.-i.x:(mn.)i-^m 
%'i!!ifi>mx'hi(nx\ assE^jfi^ (AF-tynf-^ 

(AFXUT) titL-CS^<^^$-frl.^fc*™i: 
[ 0 0 4 6 ] i^Wmm 1 Tii. fe7 ^ )V9 1 

LT. w.'ky ov^tm^y ^)V^im\^x\^h<r)X\ 
9i^^Lfz^\i. hh-^oi-^y^x-m^L. «fe 

7 /l-^- ^ jioi L;t:3fc^{±ffe« 2 yi^T^T 
2-:><r)m.^'itmLXM*)^^tsZbtim^b^j:h. 
[ 0 0 4 7 ] 1 X'M. Mfe7 -^ 

$:G7-f;W^fcL. fflfe7-f;^^S:M7-^;^^'t Ucc^ 
•C, mfe^'f^-x-fey-9--S:ffifflU^J*^(:. G7^ 
/l^^J'SriffiSUciK^^Gfe-by-tfCSaL. y[y<)V^ 
S: jKS Uc jid^li Rfefc J; B fe-fe yif-T'Stt-ri, ^ 

[0048] mm<r>im2) me\,±. m^mM2\,z 

^hf'J^)Viiyi=y<r>AFm^^m^i^-t. 06 



1 1 

mmmitm^jmm. 2»5cffti$2oo. 2 
t^<7)r-i!^F (u, V) . G (u. V) mmm.^^ 

[0049] mM(r)mM2cr)fi^i')V'>tl^yl>Z}5\,^X 
A FX 'J 7<mm.'f-i>b 3\^M tJC tJt A FX U 7 

im^izmrst . A F 1 0 1 ffy^m.tx'ffim. 

^•th. mmz\i. nmm^ui i at^io, af 
xu 7<mm-'^<nmwm.mt¥\:-'?ttch!^.i% 

tiSt, ffiJi:^riii]©tBgi5l0 8{i, AFxUTc7)H«r- 

^mQsx-n^^titz-^&Mtx'. AF^yxio 
[0050] mLmmLtzi. 0 imm<r)mm2x: 

{i, AFgf>3 1 0 2{i. AFP-yXi 0 1<?)4"C4;:^L 

(G7'f;^^'l 0 2a, my^)V^\ 0 2b) J-^-i? 
EML, AF07t*^<7)»mf{i, AFgJO 1 0 2C0#fe 
7^;l'^'102a. 102bSrji3ii1-|,#3t^tJ£t/i 
B«7 l^-ArtcO A FX U r£7)HfilT- ^ 5:feg'JtCflXff 

ffi5fflM«a[a5io6{±, m.mmm'-m 
sffisfflM^ictca-:^^, AFvvxi 0 1 commas 
§^>K. mm^m.m&mx\ ^mmLmi 1 3 

{i. amLT^I^>^l.;tAFx>Jr«BmT-^^o^^& 
-rs 2 <ji:7cF F Tgpt'J5?smfiaiJ-S:^>^)S b . 

[ 0 0 5 1 ] i^. *^BBI±±fEU/l»feO}g®t[iSS$ 

^ss^mx'hi, 

[00 5 2] tti. :^WM<^m■^^m^i. ^t^^ 

[00 53] 

WliiMMmzXtHi. AFUyX(omz1eilXlS.\'^z 

m^j:mmmi,zmnm^M'tL¥i.htL, m^ma 
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1 2 

y^n^m^m't^<^^i:mmti> a Fg? 0 jrisft, 
mfgi-$timmyu~j^<D-^i AF Jivrt ltiss 

AF<7);ti>^><^t8«T'{4, AFg?'50#fe7'r;l'^S: 

MMti^tm<>z^^iBtt:^m%y u-ap^coa fx 

U7<^BfilT-:5'S:5^^IXf#L, AFxur<50HffiT- 

m<7)n:s.mmi:mtiiL. 'mmsmizm-:s^AFu 
yxcr)-^(mtx'<r)mitm^M.tiitx. smaf 

[00 54] ii^2t^l.Sii^^B{cJ;n 

{f. w^iiEK^ei&^^atciJv^-r, P^^fe? 

^)V9(r)-:^iW.^y miim^y^iv^ 

<r)2^(r)-ty^xm'^X't . 2^(r)m.-k'rtmLXM'0 
20 [ 0 0 5 5 ] tf^3t^Sei)^gBt itl 

{f, ii^2iB««oi»-&^at*5v^T, w.^y<)V 
^iQy A)Vi^bL. m&y^fi'i'iMy-ov^tlt: 

(r)X\ p(-'J-^yt-^mmtf.ii%-^i,z. ay 

^rm^lt:^iiR^t5Xx/B^^y^-X'm\tl 
Ztt/^X'^^ 2-:>(7m^t:^mLXmilts^bP^ 

[ 0 0 5 6 ] lf*]l4t^Sg»^gafcJ;ix 

, A f p yx<o4"D tst tTsv ^zm^im'i^&mz 
t,(r>mmmfhAFmi:'m. m^nm^y 

^-ixCO-gP^rAFxyrtL-TlSSL. AF(Dtiib<7) 

mi&x'iti. AFg?i9<o#fe7.f;p^'^3iii-ri.#3fe^{= 
^^mtt:^miSkyi^-M>fH(^AFj:^jT(ommf—}' 
i^^m%u AFx>jrc7)B«T-^'is<7)ffl5fflWf- 

»[tfJL, aSfflSfflMtcS^^. AFuyXff)^&M 
tX'COWmbljl^trMliilX. ^mAFUyXcoWmco 

40 LTff ^>ti;t A FX U T«afilT-^'<o«^&^^t;3 

[01 ] ^M^OJgMl t^-Siili-^^liaSr3ifflt;tT 

[112] 01<OJIfei^^^-i;-byHf-coH«7W-A 
is itX^OAFx i; r ^^-f H-CJ)!. . 

[113 ] lal^oAFig^o^wJ;l,5i£^colROji^s•ii^Bfl■f- 
l.^i6^oij^Hfl0•c^>l.. 

50 [14] lllcOTx^'/l^>&;<7(5DAFcOSaS:ittBB1-|) 
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1 3 

[05] AF X.U 7(r>Gy ^ Xx/My ^ fU^ffM 

[06 ] mmmB2m?> m^^M^mimttiT 

101 Kvvyx 

102 AFiB?0 

102 a G7^;P:5' 

102b my-{)V^ 

103 igfeJ^^^-i^'-byH?-- 

104 B«;<^U (7-f;P:}'Gc7)AFXi;Tffl) 



10 



14 

105 Mfli^^u (7-f;L'^'MOAFxyrffl) 

1 0 6 ffiSfflMJi^gS 

107 ffiSffire^S;^^U 

1 0 8 SEirS-lfilEtBgp 

109 k.¥%^ihmsm 

1 1 0 m'mm 

111 7^-2.fflMfil^^'J 

1 1 2 m^jn^gp 

1 1 3 i§m«iajsi5 

2 00 2}J^7CFFTgg 
20 1 2<}^7UFFT^ 

2 0 2 -mm-u 

2 03 2<J?7ClFFTgP 



[01] 



[02] 



101 AFUVy 



103 

^ ■B>ir— 



r 



s 







3m 



1 f _j^2ao 



FFT 



FFnSf 



(202 



2^3£lFFT® 




\ 

















AFi y 7 




(b) 




t02 101 102 



[113] 




C«fe7<iU5t)l02b 



1 ^ 


R 
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1 *^ 








> 





104 



105 
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[05] 



[06] 



Setter*- ^ H«f*-4' 
[ AFX'JT J I AFIUT' ) ^ -"WW** 
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31 -F 



32 
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33 -F 




^^/O^^ it* 102b 



1 110 
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106 
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